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Abstract 

Introduction. This paper reports an exploratory study examining how users participate 
in social tagging activities in a scholarly digital library environment to leam about their 
motivations, behaviour, and practices. 

Method. This study was conducted in two phases: a survey to investigate usage and 
attitudes of social tagging tool, and a task-based user study on tagging practices in 
Theses@UMalaya followed by a post-task questionnaire and interview. A total of thirty 
-seven responses were gathered out of 160 respondents giving a 23% response rate. 
Analysis. Responses to the study were analysed using SPSS while qualitative data were 
coded to bring together the emerging themes. 

Results. The survey demonstrated that the majority of the participants have not used 
social tagging before mainly because they were unaware of the existence. The 
participants used keyword that most closely related to describe the documents as a tag. 
Usability of the social tagging application was evaluated using SUMI and PLE 
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constructs. The participants indicated the social tagging tool was relatively more usable 
rather than providing them with the ability to carry out the tagging process with less 
effort. 

Conclusions. A better understanding of social tagging usage and usability will help to 
improve future development of social tagging tools in digital libraries. 


CHANGE FONT 


Introduction 

Social tagging services such as Delicious, CiteUlike and PennTag offer an alternative mechanism for 
resource discovery and browsing of digital resources (e.g. website, scholarly papers) through tags that 
were added by users. The tags also serve as ways for users to organize their information based on 
their own preference for future retrieval. However there are conflicting opinions that social tagging is 
too flexible and do not have enough control over the vocabulary (Lu, Park and Hu, 2010). This is 
often criticized for imprecise and ambiguously chosen keywords for tags when compared to 
conventional classification scheme used by professional indexers such as librarians or in formation 
specialist who manually categorize the resources. But with the advent of Internet which has radically 
increased the amount of information to the public, to continually manually categorizing resources by 
professional indexer is not only impractical but costly as well. 

To add into that, in these recent years, many academic institutions have taken the initiatives to 
develop digital repositories or also known as digital libraries to preserve, publish and disseminate 
scholar communications (e.g. pre-print articles, thesis, dissertation and etc.). In order to make these 
resources freely and widely visible and available, many institutions opt to self-archiving their 
resources through open access initiatives. In self-archiving, the document producers or owners are 
responsible to deposit their resources and create metadata to describe the documents. This is 
important mainly for indexing and retrieval purposes. However, the keywords chosen for the metadata 
elements are inconsistent because the document producers/owners have little or no knowledge about 
indexing. As a result, it makes the retrieval process difficult. One possible solution is to incorporate 
social tagging tool into digital repositories/digital library to empower users to actively participate and 
contribute to its community by allowing them to freely attach their personal tags to the digital 
resources. 

The research presented in this paper investigates the use of social tagging in a scholarly digital library 
environment named Theses@,UMalava. which serves as an institutional repository providing digital 
collection of thesis and dissertation belonging to or related with University of Malaya in Malaysia. 
Theses@UMalaya was developed using Dspace, a free open source software developed by 
Massachusetts Institute of Technology and Hewlett-Packard Laboratories in 2002. For the purpose of 
this study, social tagging facility was added to Theses@UMalaya and made available to users. This 
study is exploratory in nature with the main purpose of examining how users participate in social 
tagging activities in order to learn about their motivations, behaviour and practices. A better 
understanding of users’ knowledge, habits and interactions with the social tagging application can 
help to improve the design, development and eventually the usage of digital library. 
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This paper is organized as follows: the next attempts to shed light on the fundamental concepts of 
social tagging and related studies; this is followed by a brief discussion on the research objectives and 
methods, followed by a presentation of the results, a discussion of the findings, and finally, 
conclusions from the research and some proposals for future work. 

Social tagging in libraries 

Social tagging is a process of adding tags or keyword freely to online resources which is an important 
aspect of social bookmarking services that resulted in folksonomy. While taxonomy and ontology are 
classifications and naming conventions prepared by experts, folksonomies are result from individuals 
freely tagging resources available in the Internet. Social tagging, which is also kn own as collaborative 
tagging, social classification and social indexing is a process where users mark or annotate websites 
or digital objects they come across on the internet which they find useful. The main intention is to 
facilitate their access in the future by enabling them to search using the keywords they have tagged to 
the resource. By using social tagging, information can be categorized in ways that bring meaning to 
users. Users can “tag” or describe information using their own words as they see fit and meaningful to 
them. Although users tag an item with the intention of their own consumption, the result of the 
tagging produces collective intelligence as it is shared in Internet community (Anfinnsen, et al ., 

201 IT Social tagging also allows individuals who have similar interest to connect with each other 
thus facilitating sharing of infonnation. According to Marlow et al. (2006), in addition to the 
collection of information, the taggers develop social relationships among themselves which in itself is 
a useful discovery. The tags that are assigned to the online resources normally appear in a tag cloud, 
the high frequency of tag assigned is indicated by a bigger and darker font size. 

With the emergence and popularity of Web 2.0 and social tagging applications, a number of libraries 
have integrated applications such as Delicious, LibraryThing, PennTag, and Connotea into their 
library environment ( Allen and Winkler, 2006; Furner, 2007 ; T Thomas, Caudle and Schmitz, 2009; 
Lawson. 2009: and Anfinnsen. Ghinea and Cesare. 201 I T Librarians believed that social tagging 
applications which produce folksonomies could help library users to catalogue or tag the resources 
they use in their own way, and furthermore, share the information by inviting others to view, 
comment, rate and give feedback (Ram and Kataria, 2011) . Mathes (2004) also mentioned that 
folksonomies can facilitate and improve controlled vocabularies in subject headings by adding free 
tags or keywords to describe resources that are more meaningful to them. Pikic and Mucnjak (2010 1 
described the usefulness of social tagging since it can categorize and store information such as 
images, bibliographic records, and pdf files from library catalogue in anyways which suit them best. 
Kapucu, Hoeppner and Dunlop (2008) discussed about social tagging challenges and compensationit 
returned to library. Social tagging tools offer users with a new way to organize and share information 
using folksonomies by freely adding tags to it. However, library would in some way lose authority 
control as the tags are assigned using users’ natural language and not using control vocabulary in a 
normal cataloging scheme. Nevertheless this drawback is compensated in that library could learn 
about information seeking behaviour of the users by observing how they categorize the information. 
Refthlefsen (2007) echoed “now social bookmarking and tagging tools help librarians to bridge the 
gap between the library’s need to offer authoritative, well-organized information and their patrons’ 
Web experience.” 

A number ofempirical studies have reported on experiences using social tagging tools in libraries. For 
example, University of Pennsylvania who implemented PennTag allows users to tag their library 
OP AC. PennTag enabled members of the university’s community to not only tag but also comment on 
resources in the library’s online catalog ( Allen and Winkler. 2006 ). Other software similar to PennTag 
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are Social Online Public Access Catalog (SOPAC), and LibraryThing. SOPAC is developed by Ann 
Arbor District Library (AADL) which allows library users to assign tags to individual library 
resources, or to write review or comment andto view the list of the most popular and recent tags 
(Fumer, 2007) . LibraryThing (www.librarything.com) on the other hand is a cataloguing and social 
networking site for book enthusiast where they can tag, rate and review books. In 2007, Wenzler 
(2007) reported an initiative taken by Danbury library that added LibraryThings widgets into their 
library catalogs. A few other studies later are conducted to compare LibraryThings with other subject 
heading classification scheme such as Lawson ( 2009) who analysed Amazon and LibraryThings tags, 
Thomas, Caudle and Schmitz (2009) who compared the tags in LibraryThing books and LC subject 
headings. Most recently Voorbij (2012) examined whether or not books drawn from LibraryThing 
carry tags. 

Succinctly, libraries are taking advantage of social tagging tools and folksonomies into their OP AC to 
become collaborative and interactive. However, it is evident from the literature that social tagging has 
not yet become prevalent in digital libraries environment or institutional repositories as apposed to 
tagging application in conventional library environment. Thus, for this particular reason this study is 
conducted to fill the gap. 

Research objectives and method 

This study is exploratory in nature which starts with an investigation on the use of social tagging 
application in a digital library as a means to improve document organization and retrieval of scholarly 
materials. The specific objectives of the study are: 

1. To investigate the usage of social tagging application in educational setting 

2. To investigate how the social tagging process is conducted by users 

3. To examine how usable the social tagging application is to users via Software Usability 
Measurement Inventory (Software Usability Measurement Inventory) 

4. To investigate whether the provided social tagging application allows users to carry out the 
tagging process with less effort by examining the principles of least effort 

5. To examine if any relationship exist between Software Usability Measurement Inventory and 
principle of least effort constructs with regards to social tagging activities 

This study was conducted in two phases;, the first phase is an exploratory survey to investigate 
participants’usage and attitudes towards social tagging application that essentially has addressed the 
first research objective. The survey consisted of 14 questionnaires which focuses on: examining social 
tagging usage and non-usage in academic setting; frequency of use; types of social tagging system 
they have used or heard before; the purpose of usage or intention to use; and reasons for non¬ 
usage.The survey ends with an open ended question asking participants to give comments on social 
tagging application or practices. The participants then were asked to include their contact if they 
would like to participate in the next phase. The survey was distributed to graduate students in a 
computer science faculty using printed and online survey form for the duration of one month from 
July to August 2012. A total of 37 responses were gathered out of 160 respondents giving a 23% 
response rate. Out of this, 33 participants agreed to participate in the next phase. 

The second phase required participants to carry out a task-based user study on social tagging process. 
This is then followed by a post-task questionnaire and interview. The user study process is carried out 
at a computer lab in the computer science faculty where a short introduction to the social tagging 
application was given to the participants. The participants were given 15-20 minutes to familiarize 
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themselves with the social tagging application that was embedded in a digital library of thesis 
(Theses@UMalaya, available at http://dspace.fsktm.um.edu.my/) after which they were asked to carry 
out a tagging task. Participants were given a scenario and tagging tasks to be completed as shown in 
Figure 1. 

After completing the user study, participants were invited to complete an online post-task 
questionnaire to evaluate how usable and easy the social tagging application is to them. For the 
purpose of this evaluation, Software Usability Measurement Inventory (Software Usability 
Measurement Inventory) is adopted. The reason Software Usability Measurement Inventory is chosen 
as the underlying model is because it not only measures the quality of the tagging application from the 
users’ point of view (Kirakowski, 1993) , but it also measures how user feels about the application 
(Bevan and Curson, 1997) . In addition to Software Usability Measurement Inventory, the social 
tagging application was also evaluated via the Principle of Least Effort (principle of least effort). 
Literature has shown that human tend to choose the path of least resistance or effort when carrying 
out tasks, and therefore, the social tagging system was evaluated to assess if it exhibits this principle. 

The post-task questionnaire consists of 17 questions adopted from Software Usability Measurement 
Inventory to measure the following 5 constructs: Affect, Learnability, Efficiency, Helpfulness, and 
Control of the social tagging application. The other 15 questions look at the 5 construct of principle of 
least effort; Convenience, Accessibility/Availability, Ease of Use, Saving of Time, Familiarity. A five 
point Likert scale (l=Strongly Disagree, 2=Disagree, 3=Neutral, 4=Agree, 5=Strongly Agree) is used 
to indicate participants’ agreement or disagreement of both Software Usability Measurement 
Inventory and principle of least effort constructs. Table 1 and Table 2 list the definition of each 
construct used in the questionnaire and the corresponding question numbers for Software Usability 
Measurement Inventory and principle of least effort respectively. 
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Figure 1: The task-based user study and post-task questionnaires on social tagging 


Table 1: Definition of constructs in Software Usability Measurement Inventory evaluation and 

questionnaire item 


Construct 


Definition 


Affect 


The participant’s feelings about using the system (Oulanov and Pajarillo, 
2001 ) 


„ r.j~ . The degree to which the system is able to achieve its goals and tasks 
Efficlenc y (Oulanov and Pajarillo. 2001) 


Helpfulness 

Control 


The feeling by the user that the program can assist in resolving system 
problems or difficulties ( Oulanov and Pajarillo, 2001) 

The feeling by the user that he is in control of the software, as opposed to 
being controlled ( Claridge etal.. 1998 ) 


Leamability 


The degree to which the user can learn and use the system (Oulanov and 
Pajarillo, 2001) 


Questions 

I to 4 

5 to 8 
9 to 10 

II to 13 
14 to 16 
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Table 2: Definition of constructs in principle of least effort evaluation and questionnaire item 


Construct 

Convenience 

Accessibility / 
Availability 

Ease of Use 

Saving time 

Familiarity 


Questions 

17 to 20 


Definition 

Able to proceed with information system with little effort 

(Connaway et ah, 201 1) 

Information is at hand when needed. Aparticular source available at 2 j to 24 
a particular time f Fidel and Green. 20041 

Can be used without having to overcome a steep learning curve. 

Friendly and easy to use interface (Bronstein, 2010) 

Able to perform a task in a shorter time ( Fidel and Green. 2004 1 
User have previous knowledge or experience with the items ( Pu and 

Chen. 2010 4 


25 to 27 
28 to 29 
30 to 31 


A total of thirty-three participants participated in the task-based user study, and eighteen of them 
volunteered to take part in the following interview sessions. The interview session was carried out to 
gather in-depth understanding on how social tagging process is conducted by participants, and lasted 
for about fifteen minutes each. The second phase of this study has essentially addressed the second, 
third and fourth research objectives. 

Responses to the survey and post-task questionnaires were analysed quantitatively using SPSS and 
were supported by participants’ responses to open ended questions which were coded as C1-C37 and 
T1-T33 respectively. Responses from the interview on the other hand were analysed to bring together 
the emerging themes and the responses were coded as N1-N18. 


Results 


The usage of social tagging application in educational settings 

The survey was conducted for the duration of one month in July 2012. A total of 37 responses were 
gathered with 68% (25) of female and the remaining 32% (12) were male. Out of the total responses, 
a majority of the participants have not used social tagging with 57% (21) and only 43% (16) of them 
have used it before. 

Participants who have used social tagging or bookmarking software before (N=16) indicated that they 
do not remember how frequent they use it, often indicated as rarely, and depends on the needs 
(24%).When asked about which social tagging or bookmarking software they have used, the 
participants indicated that they have used CiteUFike most (27.0%), followed by Del.icio.us (21.6%). 

Have Not Used Social Tagging/Bookmarking Before (N=16) 

The survey demonstrated that participants used social tagging application for different purposes as 
shown in Table 3. The highest response indicated by participants in using the social tagging software 
is to share information with others (20%). However, the most responses (35%) indicated that other 
purposes are also evident and one such example is using it in Facebook. The survey also revealed that 
participants preferred to use personal tags as the 1st rank, followed by content-based tags, and tags to 
indicate ownership. Table 4 shows how the participants become interested in using social tagging. 

The participants indicated that they come to know about social tagging application through reading 
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(18%), self-taught (16%), and from colleagues (16%). The highest percentage (52%) however was 
indicated by “do not remember”. 


Table 3: Purpose of using social tagging application (N=16) 


Purpose of using social tagging application Responses (n) Responses(%) 

To share information with others 

12 

20% 

Describe the resources to add value 

6 

10% 

Future retrieval 

6 

10% 

Task organization 

5 

8% 

Document organization 

4 

7% 

Refine the resources category 

3 

5% 

Technological ease 

3 

5% 

Other 

21 

35% 

Total Responses 

60 

10% 

Note: Participants could select more than one option 



Table 4: How participants become interested in using social tagging (N=16) 


How did you first become interested in using social tagging? 

Responses (n) Responses (%) 

Colleagues 

6 

14% 

Self-taught 

7 

16% 

Reading (books, journals, online etc.) 

8 

18% 

Other (do not remember) 

23 

52% 

Total 

44 

100% 


Note: Participants could select more than one option 


Have not used social tagging or bookmarking before (N=21) 

Participants who have not used social tagging or bookmarking software before (N=21) indicated that 
the main reason of not using it was because they were not aware of their availability and there was no 
need to use them as demonstrated by 10% respectively as shown in Table 5. Table 6 on the other hand 
demonstrates for what purpose the participants might use social tagging in the future. The highest 
reason was for sharing infonnation (12%) followed by for future retrieval (10%). 


Table 5: Reason for not using social tagging (N=21 


Reason for Not Using Social Tagging 

Responses (n) Responses 

Not aware of their availability 

10 

24% 

There is no need 

10 

24% 

Takes time to get familiar with the technology 

6 

14% 

Others 

16 

38% 

Total 

42 

100% 


(%) 
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Note: Participants could select more than one option 


Table 6: Intention to use social tagging in the future (N=21) 

Intention to use social tagging in the future Responses (n) Responses (%) 


To share information with others 12 19% 

Future retrieval 10 16% 

Document organization 7 11% 

Task organization 5 8% 

Describe the resources to add value 4 6% 

Refine the resources category 4 6% 

Technological ease 4 6% 

Other 16 26% 

Total Responses 62 100% 

Note: Participants could select more than one option 


Table 7 lists participants’ comments on the social tagging practices in an open ended question. Most 
of the comments were indicated by not aware of social tagging application (5 responses) although the 
participants opined it is useful to them as demonstrated by 4 responses. 


Table 7: Participants’ comments on social tagging 

Participants’ comments on social tagging application in educational 

setting 


Participants 


Not aware of social tagging application 

Useful 
Save time 

Facilitate resource sharing 
Easy to use 

To get more information about social tagging application 


C12, C13, C14, C25, 
C36 

Cl, C22, C36, C37 
C37, C18 
C6, C7 
C22, C37 
CIO, C14, C36 


Investigation on how the social tagging process was conducted by users 

Interview sessions were carried out to gather in-depth understanding how social tagging process is 
conducted by participants. From a total of 18 participants interviewed, 15 (83%) of them have never 
done social tagging (or social bookmarking) in educational setting before although they have 
indicated of doing that in other social media websites such as on Facebook and Flickr (N2-N8, N11- 
N18). This is evident from some of the remarks: “I usually do tagging in Facebook only” (N3); “I 
use Facebook to tag my friends ” (N2). The reason of not using tagging in educacational setting was 
mainly because they were not aware of such applications as indicated by 14 (78%) participants (Nl, 
N2,N4, N6-N8, N10-N13, N15-N18). Participants also indicated that it took time for them to learn 
new technology. 
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When asked on how they carry out the tagging process, the participants generally use keyword they 
think most closely related to describe the documents they read to become the tag as indicated by 10 
(55%) participants (N2, N3, N6, N8-N10, N12,N13, N15, N18). However one participant mentioned 
to use using numbers to tag documents (N10) and use type of documents e.g. journal (N4) as a tag. 
According to the participants, the chosen words for the tagging are mainly from the documents 
content (6 participants, 33%) ,title (5 participants, 28%), or abstract (3 participants, 17%). Conversely 
it was interesting to note that one of the participants actually chose word that is not in the title and not 
among the document keyword as the tag “.... as I was reading the abstract, the research was about 
exploring users expectations, and ‘user expectation ’ was not in the title and was not among the 
assigned keywords. That’s why I use it ” (N4). 

Seven participants (39%) indicated that the social tagging application was easy to use (N2, N3, N6, 
N9, N10, Nil, N12). In addition to that 9 participants (50%) of them opined that the application was 
useful for future retrieval, sharing information and quick access (Nl, N5, N8, N10, Nil, N12, N17). 
Some of the responses pointed out that: 

It's good in helping us to categorise some documents (N8) 

I can read other relevant documents in the database by the same tags” (N9) 

I believe it would be helpful if I’m using it from the beginning. If I’m reading it, all the 
theses, and then assign the tags, it will help me to find a particular thesis, for example I 
remember that I was reading something about this in the thesis, and then I forgot. If I see 
tags I can easily find it (N4) 

It's quite easy to use tagging because it helps to speed up searching by looking at relevant 
documents to us. Not only to us but also documents used by others and what are the most 
frequently used too. So generally it helps a lot.” (N18) 

Nevertheless, some participants pointed out that it was difficult to choose the right tag as indicated by 
N4, N6,and N7 who said “.... difficult to choose the right tags so that they are relevant and useful to 
you for future retrieval, however, you spend much time on choosing the right word alone (N7)”. N17 
added difficulty to choose one single word as a tag as he/she said “It was slightly difficult to choose 
one word to describe one bib text”. Other than that participants were concerned that the tag would not 
be useful enough if it is similar to the document title or the assigned keyword for the document (N4), 
and the tags assigned might not be correct (N9). 

After using the social tagging system, some of the participants suggested a few recommendations to 
improve the application such as to be able to organize the documents in folders (Nl, N8) and be able 
to edit the tags (N9),They would like the application to give recommendation keyword as the tags 
(keyword that have been used previously) (N9, N16), auto-complete the spelling as they type-in the 
tags (N9), and to present the tags in hierarchy order (N9). 

Examining the usability of the social tagging application 

Usability of the social tagging application was evaluated based on 5 Software Usability Measurement 
Inventory construct. Table 11 lists the frequency percentage for each questionnaire item including 
both the positive and negative statements of the 5 construct. The negative questionnaires item are used 
to serve as a bias control for Software Usability Measurement Inventory constructs.The negative 
questionnaire or the reversal items are marked with “(**)” next to the question. For the reversal item 
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questions, the response value is reversed before it is included into the table to calculate the means of 
the relevant Software Usability Measurement Inventory construct. For example if the participant gave 
a 1, that score is reversed to be 5; if the given score is a 2, it is reversed to 4; 3 = 3; 4 = 2; and, 5 = 
l.The final score for each construct is the sum of the ratings for all the items for that particular 
construct. 

As shown in Table 8, all of the Software Usability Measurement Inventory items statements result in 
a value above 3 point of Likert scale, and the highest frequency of each item were generally on the 
4=Agree scale except for item number 4 “I don’t understand why I should use my time on adding tags 
(**)” where there were equal percentage (21.1%) for 2=Disagree, 3=Undecided and 4=Agree. The 
mean value however indicated towards a positive response which is M= 3.5.The usability of the social 
tagging application is evident from Software Usability Measurement Inventory overall mean value for 
each of the constructs where the highest mean value was for Efficiency (M=4.0), followed by Control 
(M=3.9), Affect (M=3.8), Helpfulness (M=3.8),and Learnability (M=3.7). 


Table 8: Frequency and mean value for each Software Usability Measurement Inventory item 


1 

2 

3 

4 


5 

6 

7 

8 


9 


Affect 

Strongly 

disagree 

Disagree 

Undecided 

Agree 

Strongly 

agree 

Mean 

I am satisfied with the tags I 
assigned 

0% (0) 

3.03% 

(1) 

18.2%(6) 

51.5% 

(17) 

27.3% (9) 

4.0 

I enjoy seeing my tag 
contribution instantly appear in 
the tag Cloud 

0% (0) 

3.03% 

(1) 

18.2%(6) 

54.6% 

(18) 

24.2%(8) 

4.0 

I prefer viewing tags as a cloud 

0% (0) 

0% (0) 

39.4% (13) 

42.4% 

(14) 

18.2%(6) 

3.8 

I don’t understand why I should 
use my time on adding tags (**) 

0% (0) 

21.2% 

(7) 

21.2%(7) 

21.2% 

(7) 

18.2%(6) 

3.5 





Average for 
affect 

3.8 

Efficiency 

Strongly 

disagree 

Disagree 

Undecided 

Agree 

Strongly 

agree 

Mean 

Tags would help me to find 
material easier in the future 

0% (0) 

3.03%(1) 

3.03%(1) 

60.6% 

(20) 

33.3% 

(11) 

4.2 

Tags is a good way to keep track 
of my literature 

0% (0) 

3.03%(1) 

6.06%(2) 

63.6% 

(21) 

27.3% (9) 

4.2 

The tagging application improves 
user experience with the system 

0% (0) 

6.06%(2) 

18.2%(6) 

54.6% 

(18) 

21.2%(7) 

3.9 

The tagging process can be 
perfonned in a straightforward 
manner using this system 

3.03%(1) 

3.03%(1) 

24.2%(8) 

48.5% 

(16) 

21.2%(7) 

3.8 





Average for 
efficiency 

4.0 

Helpfulness 

Strongly 

disagree 

Disagree 

Undecided 

Agree 

Strongly 

agree 

Mean 


6.06%(2) 

0% (0) 

15.2%(5) 


21.2%(7) 

3.9 
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The word in the tag Cloud is 
helpful in assisting me to choose 
a specific tag to describe a 
document 

, A The organization of the tag Cloud , 

1U .. i . , o.Uo/o ( 2) 

seem quite logical 


57.6% 

(19) 


^■ 03% 15.2%(5) 12.1% (4) 3.7 

(U (■*!■) 


Average for 
helpfulness 


11 


Control 

I am certain that the tags I 


12 


assigned are correct 
I have concern about users adding 
tags that are not relevant 

I feel more confident when 
I ^ knowing which user (students or 
staff) has added the tags when I 
browse 


Strongly 

disagree 

Disagree Undecided 

Agree 

Strongly 

agree 

0% (0) 

3.03% 

(1) 

36.4%(12) 

42.4% 

(14) 

18.2%(6) 

0% (0) 

0% (0) 

21.2%(7) 

57.6% 

(19) 

21.2%(7) 

0% (0) 

3.03% 

(1) 

24.2%(8) 

48.5% 

(16) 

24.2%(8) 


3.8 

Mean 


Learnability 

It takes too long to learn on how 
14 to assign tags to the documents 

j I can easily remember the step to 
assign tags to the documents 

I have no idea how to use the tag 


Strongly 

disagree 


Disagree Undecided Agree 
48.5% 


Average for 
control 

Strongly 
agree 


3.9 

Mean 


0%(0) 21.2%(7) 18.2%(6) 

3.03% (1) 


(16) 


3.03% . 60.6% 30.3% 

(!) AUi/oU) ^ (1Q) 


12.1%(4) 3.5 
4.1 


16 : 


Cloud to find relevant document 


in the system (instead of using 
browse and search facilities)(**) 


(**) Denotes a reversed question 


'l'l 7 * 0 / 

3.03% (1) 27.3%(9) 18.2%(6) ^ 18.2%(6) 3.4 


Average for 
learnability 


3.7 


Examining if users are able to use the social tagging system with less effort 

The social tagging application was also examined to find out whether it provides the users with the 
ability to carry out the tagging process with less effort. This is done based on 5 constructs of principle 
of least effort as shown in Table 9. The negative questionnaires statements or reversal items were 
treated the same as stated above and the response value is reversed before it is included into the table. 
Table 9 demonstrates that all of the principle of least effort items statements result in average value 
above 3 point of Likert scale, and the highest frequency of each item were generally on the 4=Agree 
scale except for two reversal items: 
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Item no. 17. “I find it difficult to describe documents using only a single word (**)” with the highest 
percentage of 36.4% for 2=Disagree (after the item was reversed) which means that participants 
actually agree with this statement. 

Item no. 29. “It takes more time to decide a suitable tag to describe the content of a document 
(**)”with the highest percentage of 39.4% for 2=Disagree (after the item was reversed) which means 
that participants actually agree with this statement. 

The mean value for both the items mentioned above demonstrated towards a negative response (below 
3 point Likert Scale) with the average of M=2.9 and M=2.6 respective. This indicates that the 
participants were not positive towards these two particular statements. 

However, the social tagging application has generally exhibit the use of principle of least effort and it 
is evident from the overall mean value for each of the constructs where the highest mean value was 
for Accessibility/Availability (M=3.8), followed by Ease of Use (M=3.7), Familiarity (M=3.6), 
Convenience (M=3.3),and Saving of Time (M=3.2). 


Table 9: Frequency and mean value for each principle of least effort item 


Convenience 


Strongly 
disagree 

I find it difficult to describe 
17 documents using only a 9.1%(3) 
single word (**) 

I can effortlessly add tags to 


18 


the documents 


Disagree Undecided Agree 
12.1%(4) 

3.03%(1) 12.1%(4) 30.3%( 10) 


Strongly 

agree 


36.4% 

( 12 ) 


33.3% 

( 11 ) 


48.5% 

(16) 


The tags provides me with 

19 additional information about 3.03% (1) 12.1%(4) 18.2%(6) 
the content of the collection 
It is easy to decide what tags „ x 30.3% 


45.5% 

(15) 


20 


to use 

Accessibility or 
availability 

When referring to the tags 


21 . 


cloud , I can find 


3.03%(1) 

Strongly 

disagree 

0 % ( 0 ) 


infonnation that I need 
when I need it 

I can share infonnation with 
22 others by adding tags to the 0% (0) 
documents 

The organization of the tag ,. 0/ 
cloud seem quite logical ' " ! J 


( 10 ) 

Disagree Undecided Agree 

6.1% (2) 27.3%(9) 


54.5% 

(18) 


6.1% (2) 27.3%(9) 
0% (0) 21.2%(7) 


54.5% 

(18) 


Mean 


9.1%(3) 2.9 

6.1% (9) 3.4 
21.2%(7) 3.7 


15.2%(5) 6.1 %(2) 3.2 

Average for convenience 3.3 
Strongly 


Mean 


agree 

12.1%(4) 3.7 

12.1%(4) 3.7 


63.6% 

( 21 ) 

Average for accessibility or 
availability 


15.2% (5) 3.9 
3.8 


Ease of use 


Strongly j 3 j sa g ree Undecided Agree ^ tron gty Mean 
disagree agree 
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24 It easy to navigate the 0% (0) 
system using the tags cloud 

to find what is needed 
I have to look for assistance 

25 most of the times when I use 3.03% (1) 
this tagging system (**) 

It is easier for me to re-use 

26 existing tags to describe a 3.03%(1) 
document 


„ . .. Strongly 

Saving time & J 

disagree 

It takes more time to decide 

27 a suitable tag to describe the 0% (0) 
content of a document (**) 

It takes more time to decide 

28 a suitable tag to describe the 18.2% (6) 
content of a document (**) 


Familiarity 

I find the system is easy to 
understand because adheres 
29 to designs and concepts 
which are already familiar 
to me 


Strongly 

disagree 


0 % ( 0 ) 


3 Q I prefer to stick to the 
facilities that I know best 


0 % ( 0 ) 


(**) Denotes a reversed question 


6.1%(2) 

33.3%(11) 

48.5% 

(16) 

12.2%(4) 

3.6 

9.1%(3) 

15.2%(5) 

54.4% 

(18) 

18.2%(6) 

3.7 

3.03%(1) 

15.2%(5) 

66.7% 

(22) 

12.1%(4) 

3.8 


Average for ease of use 

3.6 

Disagree 

Undecided 

Agree 

Strongly 

agree 

Mean 

6.1%(2) 

30.3%( 10) 

48.5% 

(16) 

15.2%(5) 

3.7 

39.4% 

(13) 

12.1%(4) 

24.2% 

(8) 

6.1%(2) 

2.6 


Average for saving time 

3.2 

Disagree 

Undecided 

Agree 

Strongly 

agree 

Mean 

9.1%(3) 

24.2%(8) 

54.5% 

(18) 

12.1%(4) 

3.7 

15.2%(5) 

27.3%(9) 

45.5% 

(15) 

12.1%(4) 

3.6 


Average for familiarity 

3.6 


Examining if there is any relationship between Software Usability Measurement 
Inventory and principle of least effort constructs when users carry out the social 
tagging activities 

In an attempt to find out if there is any relationship between the two constructs (Software Usability 
Measurement Inventory and principle of least effort) on the social tagging practices, a statistical 
analysis was carried out using Pearson correlation. Table 10 presents a matrix to show the correlation 
between the pairs of Software Usability Measurement Inventory and principle of least effort construct. 
The significant correlations are highlighted. 


Table 10: Mapping between Software Usability Measurement Inventory and principle of least 

effort constructs 

Five Software Usability Measurement Inventory constructs 
Affect Efficiency Helpfulness Control Learnability 
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Five principle of 
least effort 
constructs 


Convenience 

0.582** 

0.465** 

0.333 

0.293 

0.333 

Accessibility or 
availability 

0.418* 

0.645** 

0.310 

0.361* 

0.310 

Ease of use 

0.295 

0.598** 

0.558** 

0.183 

0.558** 

Saving time 

0.457** 

0.293 

0.125 

0.445** 

0.125 

Familiarity 

0.445** 

0.387* 

0.513** 

0.487** 

0.513** 


** - correlation is significant at the 0.01 level (two-tailed) 

* - correlation is significant at the 0.05 level (two-tailed) 

From the responses provided by the users who took part in the evaluation process, there is evidence to 
show a significant correlation between users’ perception of Affect and the five principle of least effort 
constructs (convenience, accessibility or availability, saving time, ease of use and familiarity). 
Efficiency was demonstrated to have a significant correlation with convenience, accessibility or 
availability and ease of use. While control has significant correlation with saving time and familiarity. 
Both helpfulness and learnability on the other hand have significant correlation between ease of use, 
and familiarity. 

Discussion 

This main purpose of this study is to investigate how users participate in social tagging activities in 
educational setting particularly in a scholarly digital environment in order to learn about their 
motivations, behaviour and practices using survey, task-based user study and interview. Thus, the 
following research objectives were developed to: 

1. investigate the usage of social tagging application in educational setting 

2. investigate how the social tagging process is conducted by users 

3. examine how usable is the social tagging application is to users via Software Usability 
Measurement Inventory (Software Usability Measurement Inventory) 

4. investigate whether the provided social tagging application allows users to carry out the tagging 
process with less effort by examining the Principles of Least Effort (principle of least effort) 

5. examine if there is any relationship exist between Software Usability Measurement Inventory 
and principle of least effort constructs with regards to social tagging activities 

The first research objective was addressed using a survey questionnaire to investigate the usage of 
social tagging application. The survey demonstrated that out of a total of 37 responses, a majority of 
the participants (57%) have not used social tagging and only 43% of them have used it before. Those 
who have used social tagging before reported that they used CiteUlike most of the time followed by 
Del.icio.us. The indicated main purpose of using social tagging is for sharing infonnation as shown by 
20% of the responses. For participants that have not used social tagging before intended to use it in 
future for the same purpose which is for sharing information (19%). In addition, these participants 
also indicated the main reasons of not using the social tagging were because they were not aware of 
the application (10%) and feels that there was no need to use it (10%). 
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The task-based user study has essentially addressed the second, third, fourth and fifth research 
objectives. The social tagging application that was embedded in Thesis@Um digital library enabled 
users to gain first-hand experience of tagging in a scholarly digital library. The findings revealed that 
when carrying out the tagging process, the participants generally use keyword that they think most 
closely related to describe the documents they read to become the tag as indicated by 55% participants 
although some participants has mentioned the use of numbers to tag documents and the use of type of 
documents e.g. journal as a tag. According to the participants, the chosen words for the tagging are 
mainly from the documents’ content, title, and abstract. 

In examining how usable the social tagging application is to users, a 5 constructs of Software 
Usability Measurement Inventory (Affect, Leamability, Efficiency, Helpfulness, and Control) were 
used. The other 5 constructs of principle of least effort (Convenience, Accessibility/Availability, 
saving time, Ease of Use and Familiarity) were used to investigate whether the social tagging 
application provides the users with the ability to carry out the tagging process with less effort. The 
findings in general revealed that participants found that the social tagging application was relatively 
more usable rather than providing the users with the ability to carry out the tagging process with less 
effort. This is evident when the mean between both Software Usability Measurement Inventory and 
principle of least effort constructs were compared as shown in Table 11. The 5 constructs of Software 
Usability Measurement Inventory demonstratedmean values that close to 4=Agree scale while only 3 
constructs of principle of least effort (Accessibility/Availability, Ease of Use and Familiarity) reach 
the same scale. 


Table 11: Comparing the mean value for each construct of Software Usability Measurement Inventory 



and principle of least effort 



Software Usability 
Measurement Inventory 

Efficiency 

Control Affect 

Helpfulness 

Learnability 

Mean value 

4.0 

3.9 3.8 

3.8 

3.7 

Principle of least effort 

Accessibility or 
availability 

Ease of jr am iliarity Convenience 
use J 

Saving of 
time 

Mean value 

3.8 

3.7 3.6 

3.3 

3.2 


In addition, it is interesting to examine whether participants prior usage of social tagging application 
might have influenced their responses towards Software Usability Measurement Inventory and 
principle of least effort constructs. The t-test analysis was conducted to confirm that there is no 
significant correlation between the participants’ prior experience of using social tagging application 
with Software Usability Measurement Inventory or principle of least effort constructs. 

The study also reported a significant correlation between several Software Usability Measurement 
Inventory and the principle of least effort constructs as shown in Table 10. Based on the correlation 
results, it is can be summarised that: 

1. Participants who are able to proceed with social tagging process in a convenient way, who find 
the tag available and accessible to them, and find that tags help them shorten their search, were 
satisfied and pleased in using the application. 

2. Participants who find the social tagging application efficient also find it convenience to use, and 
they agree that the tags are available and accessible to them, and easy to use. 
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3. Participants who perceive the social tagging application as helpful and learnable also find the 
application easy to use, and has familiar features. 

4. Participants who feel in control (e.g. certain that the assigned tags are correct) with the social 
tagging system also feels that it has familiar features that can help them shorten their search 
(using the tags). 

5. Participants who feel that the social tagging application could enable the tagging process to be 
perfonned using less effort are inclined to perceive the application as being usable mainly based 
on affect (e.g. satisfaction with the tags assigned, pleased to see tags contribution in the clouds), 
efficiency (e.g. tags could aid future retrieval), helpfulness (e.g. the tag cloud is helpful to assist 
in choosing other tags, the logical organization of cloud) and learnability (e.g. being able to 
easily remember the steps when carrying out the tagging process). 

Conclusion and future research 

This study is motivated by the lack of literature reported on the use of social tagging tool in scholarly 
digital library as an institutional repository.lt is exploratory in nature with the main purpose of 
examining how users participate in social tagging activities in order to learn about their motivations, 
behaviour and practices. In addition, this study examines the usability of the social tagging tool and to 
observe whether it provides users with the ability to carry out the tagging process with less effort. 

This is based on the premises that social tagging tool should be easy to use as the tagging process 
itself relies on user participations that is particularly important in self-archiving intuitional repository. 
For both social tagging and self-archiving tools, without user participations, the system most likely 
would fail to thrive. To conclude, a better understanding of social tagging usability and how users 
interact with the tool will help to improve development of digital library as institutional repository. 
This study however was limited by a small sample size and therefore the generalization of the 
findings should be treated with caution. Future research could be conducted to examine tags growth 
and reuse that might render in design implications to enhance the social tagging application. 
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